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ABSTRACT 

Objective: Clinical management issues are 
contributory factors to mortality. The aim of this study 
was to use data from the Victorian Audit of Surgical 
Mortality (VASM), an educational peer-review process 
for surgeons, to discover differences in the incidence 
of these issues between surgical specialties in order to 
focus attention to areas of care that might be 
improved. 

Design: This study used retrospectively analysed 
observational data from VASM. Clinical management 
issues between eight specialties were assessed using 
analysis. 

Data sources: VASM data were reported by 
participating public and private health services, the 
Coroner and self-reporting surgeons across Victoria. 
Results: A total of 2946 specific clinical issues as 
deficiencies of care were reported. 15% of cases had 
significant issues of care. The most common clinical 
management issue was the delay in delivery of 
treatment. Other clinical issues included the quality of 
communication and documentation, preoperative and 
postoperative care, adverse events and protocol issues. 
There were significant differences in issues between 
specialties. 

Conclusions: The clinical management issues 
presented across surgical specialties were similar; 
however, five issues of clinical care differed 
significantly in frequency across surgical specialties. 
The three main issues varying among specialties were 
complications after operation, communication and 
postoperative care. Addressing these clinical 
management issues via the peer-review process may 
impact positively on patient care. 



INTRODUCTION 

Surgical audits and registries are established 
to measure, monitor and identify outcomes 
through the peer-review process, thus provid- 
ing feedback to the healthcare providers. 
Consequently, this type of monitoring system 
can improve patient care/~^ The Victorian 
Audit of Surgical Mortality (WSM) is a 



Strengths and limitations of this study 



■ The different specialties have not been previously 
studied in this fashion although these differences 
might be expected. 

■ Because of the limitations of the data set, 
in-depth analysis of the reasons for these differ- 
ences is not apparent. Small numbers reduce the 
impact of differences in some specialties and 
exclude a few from analysis completely. 

■ The mortality audit is confined to deceased 
patients and clinical details are not available for 
predictive analysis. 



retrospective observational clinical audit that 
follows the operating principles of Australian 
clinical quality registries as specified in the 
Australian Commission on Safety and Quality 
in Health Care.^ 

\ASM is part of the Australian and New 
Zealand Audit of Surgical Mortality 
(ANZASM), a binational network of region- 
ally based audits of surgical mortality that 
aims to ensure the highest standards of safe 
and comprehensive surgical care. \ASM was 
established in 2008 in collaboration with the 
Victorian Surgical Consultative Council 
(VSCC) and is funded by the Victorian 
Department of Health with infrastructure 
provided by the Royal Australasian College of 
Surgeons where it is responsible to the 
Professional Development and Standards 
Board via the Research, Audit and Academic 
Surgery Board. 

WSM's peer-review component is similar 
to its interstate counterparts (figure 1). All 
deaths that occur in the hospital either post- 
surgery or while in the hospital under the 
care of a surgeon are peer reviewed. To 
appraise the appropriateness of the clinical 
care provided in each case, all cases undergo 
first-line assessment (FLA) and a minority of 
cases also undergo second-line assessment 
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Figure 1 Victorian Audit of 
Surgical IVIortality (VASIVI) audit 
process. 
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(SLA). During peer review, clinical management issues 
would be identified. 

Currently, evaluating outcomes for many audit and 
registry activities focus on specialty-specific clinical man- 
agement issues.^ The aim of this study was to examine 
\^SM data for differences in clinical management issues 
across specialties. It was hypothesised that clinical man- 
agement issues would be similar across the specialties 
but that the degree of severity would vary. 



METHODS 

This study utilised observational data, retrospectively 
analysed. It examined 'clinical management issues' as 
deficiencies of care per specialty. Data from the audit 
period 1 January 2008 to 30 June 2012 were analysed by 
a mixed method approach using quantitative and quali- 
tative data. Ethics approval was granted by the Victorian 
Department of Health Ethics Committee at inception of 
the audit to ensure compliance with privacy legislation. 
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Participation of the surgeons was covered under the 
Commonwealth Quahfied Privilege Scheme, protecting 
the confidentiality of information created as part of the 
audit. 

The \^SM data were reported by participating public 
and private health services, the Coroner and self- 
reporting surgeons across Victoria, which had a popula- 
tion of 5 623 500 as in June 2012. Clinical data were 
collected on 2 400 542 patients who underwent surgery 
in 250 Victorian public and private hospitals, including 
surgeons who treated the patients and their specialty. Of 
the 5585 surgical deaths reported from 79 hospitals 
since 2008, only 2862 (51.24%) cases completed the full 
audit process, as described in figure 1, which involved 
an FLA and an SLA. From this data pool, 559 (19.53%) 
were referred to a second-line peer review. The remain- 
ing 2723 (48.75%) of 5585 cases not included in the 
analysis were pending completion or excluded as ter- 
minal care or incorrectly attributed to surgery. 

There were 1082 surgeons in Victoria of whom 957 
(88.45%) were recruited into participation in WSM. 
The audit data represented 13 specialty-craft groups. 
Data were analysed for eight of the specialties: cardio- 
thoracic, general, neurosurgery, orthopaedic, otolaryn- 
gology/head and neck (ENT), plastic, urology and 
vascular surgery. Ophthalmology, gynaecology, paediat- 
ric, maxillofacial and other (trauma, transplant and 
oncology) specialties (33 cases) were excluded from this 
analysis due to low numbers of clinical issues (<35). 

Clinical information such as diagnosis, cause of death, 
course to death, risk status, operative profile, clinical 
management issues and reviewers' comments were col- 
lected, entered and coded into the custom-built audit 
database. SLA involved a rigorous review of the 
de-identified surgical case record form, medical notes 
and the first-line assessor's comments. If a clinical man- 
agement issue was identified during peer review, it was 
classified as an area for consideration, area of concern 
or adverse event, according to its importance in contrib- 
uting to mortality. There were two possible outcomes: 
either death was a direct outcome of the disease process 
and clinical management had no impact on the 
outcome, or there was a perception that aspects of 
patient management may have contributed to the death 
of the patient. The outcome from the peer review was 
passed onto the treating surgeon to close the educa- 
tional loop of the audit. ^ 

Quantitative analysis was conducted using the 
StatsDirect statistical package^ and Microsoft Excel 
(2010). Categorical variables have been compared for 
the eight specialties with more than 35 clinical manage- 
ment issues using rxc ^ analysis. The Fisher- 
Freeman-Halton exact test output from StatsDirect was 
chosen to determine nominal independence. 

Data were also analysed, both as an aggregate and per 
specialty, using a thematic analysis approach. Thematic 
analysis is a qualitative method that provides a structure 
for reviewing the descriptive data to generate 



themes.^ This involved Read-Coded data being clus- 
tered and reclustered in accordance to its clinical rele- 
vance to establish clinical management issues data for 
each specialty. Categorical variables were the outcome of 
this analysis and descriptions of the main clinical man- 
agement issues and categories are listed in online sup- 
plementary appendix 1 . 

RESULTS 

The average age of patients who underwent surgery was 
80 years, with a range from 1 day to 102 years. The major- 
ity of surgical deaths occurred in the 75-85-year age 
group. The presence of comorbidities increased the risk 
of death. Presentation to the emergency department with 
an acute life-threatening condition often required surgi- 
cal intervention. The emergency admissions usually had 
an American Society of Anesthetists (ASA)^^ grade of 4, 5 
or 6. Surgical cases with an ASA status over 4 were more 
likely to be referred for an SLA.^^ Table 1 outlines the cat- 
egories of clinical management issues. The largest cat- 
egory is 'delay in definitive treatment' with 638 of the 
2946 specific issues cited. This category has been further 
subdivided; data not shown are of the following subcat- 
egories: delay in diagnosis, 153 (5.2% of all issues); delay 
in transfer to surgical unit, 148 (5%); delay in surgery 
where earlier operation was desirable, 129 (4.4%); delay 
in recognising complications, 49 (1.7%); delay in starting 
medical treatment, 34 (1.2%); delay in transfer to tertiary 
hospital, 27 (1%); delays in patient care, 11 (0.4%); delay 
in fully investigating the patient, 11 (0.4%); delay in 
patient presenting, 11 (0.4%); and delay in operation 
caused by missed diagnosis, 11 (0.4%). 

Table 2 shows that the majority of the 2862 audited 
deaths — 2400 (84%) — had no, or only minor, clinical 
management issues. In 453 cases (16%), major issues of 
care were identified (areas of concern and adverse 
events). Relevant data were missing for nine cases. 
Multiple clinical management issues could be identified 
per case. A total of 2926 clinical management issues were 
identified from the peer-review process. Clinical manage- 
ment issues which were perceived as having 'probably 
contributed to death' accounted for 182 events in 146 
(5%) cases and, in some instances, issues were consid- 
ered to be definitely preventable (179 cases, 6%). 

Figure 2 shows that the proportion of cases with clin- 
ical management issues has progressively decreased 
throughout the audit period. There were no clinical 
management issues identified for 53% of patients in 
2007-2008; by the following audit period (2008-2009), 
61% of patients received surgical care with no clinical 
management issues. Clinical management issues contin- 
ued to decrease in subsequent years so that by 2011- 
2012, 70% of patients had no issues. This was statistically 
significant (p<0.001) and highlights the benefit of peer 
review for surgical patient care. 

In the eight specialties with more than 35 issues of 
clinical management, these issues could be categorised 
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Table 2 Frequency of clinical management issues 







Patients 






affected by 




Total 


clinical issues 




occurrences 


(n=2862) 


Degree of criticism of patient management 




No issues identified 


1840 


I o4U (d4 /o ) 


Area of consideration 


1286 


can /nr\o/ \ 


Area of concern 


562 


ti/i (,y /o j 


Area of adverse event 


230 


\od [O /o) 


Missing data 


36 


O / ^ H O/ \ 

y (<i %) 


Total 


3954 




Perceived impact on patient outcome 




No issues of 


1840 


\ o4U (D4 /o ) 


management identified 






Did not affect clinical 


489 


^4o /o) 


outcome 






May have contributed 


1345 


CQQ /OH o/ \ 
oyo \ /o) 


to death 






Probably contributed 


182 


H /lO /CO/ \ 

\ 4D {D /o ) 


to death 






Missing data 


98 


QC H o/ \ 
OD {* /o) 


Total 


3954 


OQC^o M nno/ \ 

tlOOti {\ UU /o) 


Perceived preventability of clinical issues 




No issues identified 


1840 


■i QA n {CiA o/ \ 
\ o4U (D4 /o ) 


Definitely preventable 


238 


H -7Q /CO/ \ 

\ / y yO /o) 


Probably preventable 


836 


Q7P M QO/ \ 
O/O \ \o /o) 


Probably not 


739 


360 (13%) 


preventable 






Definitely not 


82 


49 (2%) 


preventable 






Missing data 


219 


56 (2%) 


Total 


3954 


2862 (100%) 


Multiple clinical management issues could be identified per case. 



into 13 categories, as shown in figure 3. The top six cat- 
egories were delay in definitive treatment (635, 22%), 
inappropriate operation (595, 20%), protocol issues 
(369, 13%), preoperative care issues (342, 12%), post- 
operative care issues (321, 11%) and complications after 
operation (252, 9%). 

The five categories of clinical management issue that 
showed statistically significant differences in frequency 
across specialties are shown in figure 4. 'Complications 
after operation' was one of the five most frequently iden- 
tified issues in urology, cardiothoracic, ENT and plastic 
surgery, while 'operation inappropriate' was a predomin- 
ant issue in neurosurgery, cardiothoracic, urology and 
vascular surgery. Under the umbrella of the 'operation 
inappropriate' category the decision to operate at all was 
the issue in 60% of these four specialties while the type 
of procedure was felt to be incorrect in 40%. 



DISCUSSION 

The establishment of \^SM was part of a national initia- 
tive by the fellows of the Royal Australasian College of 
Surgeons, in collaboration with the VSCC. The 
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Figure 2 Spectrum of clinical 
management issues across the 
audit period. Explanatory note 
under figure: Total n=2862. 
Missing data n=10 (<1%). 




None Consideration Concern 

Clinical management 



Adverse event 



I 2007-2008 



I 2008-2009 



2009-2010 



I 2010-2011 



2011-2012 



independent peer-review component of the audit has 
been regarded as a forum for sharing cHnical knowledge 
and learning outcomes. It could be perceived as subject- 
ive; however, this study reveals that the severity and fre- 
quency of specific clinical management issues identified 
as part of the audit peer review varied between special- 
ties. The most common deficiencies of care were 'delay 
in definitive treatment', 'inappropriate operation' and 
'management and protocol issues' while the three main 
issues varying among specialties were 'complications 
after operation', 'communication issues or poor docu- 
mentation' and 'postoperative care'. 'Delay in definitive 
treatment' was identified as the most severe clinical man- 
agement issue from this study and from the national 
report data.^^ In orthopaedic clinical studies on hip frac- 
ture patients, delay in definitive treatment was shown to 
be attributable to patient factors such as age and 
comorbidities, as well as waiting times to theatre. In 
the aggregate results, 'communication issues or poor 
documentation' was in the top seven clinical manage- 
ment issues. Communication problems have been recog- 
nised as the main issue in clinical care, contributing 
nearly 70% of sentinel events. 



In general, clinical management issues were similar 
across surgical specialties; however, some issues of clinical 
care were unique to a specialty as indicated in figure 4. 
'Operation inappropriate' rated highest in neurosurgery 
and urology, 'delay in definitive treatment' was highest in 
general and vascular surgery and 'postoperative care' 
highest in orthopaedic and plastic surgery. 

\^SM addressed these emerging adverse trends 
through its educational component. The learning out- 
comes from cases that underwent SLAs form the basis of 
the yearly publication of clinical case studies through 
case note review booklets which are freely available. 
These case studies have also formed topics for work- 
shops and seminars which have focused on improving 
communication among the surgical community, the 
deteriorating patient, transfer issues, conducting peer- 
review assessment and profiling the national accredit- 
ation advantages of \ASM to the Victorian hospitals. 
Benefit extends beyond the surgical community and 
other clinical teams (nursing, critical care, emergency 
and anaesthetics) have been included in our audience 
and presenters. We recognise that the surgeon is only 
one contributor to the care of a surgical patient, and 



Figure 3 Aggregate clinical 
management issues. Explanatory 
note under figure: Total n=2913. 
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Figure 4 Statistically significant 
clinical management issues per 
specialty. Explanatory note under 
figure: Total n=2913. 
ENT=otolaryngology head and 
neck surgery. 
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survival depends on quality of care at all stages of an 
episode of care. To close the education loop, the audit 
findings were also provided to its stakeholders: the hos- 
pital and healthcare services, the surgeons, the \^SM 
Management Committee, VSCC and the Victorian 
Department of Health, to ensure that appropriate 
changes were implemented. 

To validate the progress of WSM and its educational 
process, WSM was externally audited and produced two 
reports on the inter-reliability of its peer-review process. 
The findings indicated that data collected through 
WSM could be translated into improvements in the 
quality and safety of patient care which had attained a 
robust and mature status. A concordance study con- 
firmed that there was good agreement between first and 
second line assessors, as well as detecting a higher detec- 
tion rate of clinical management issues by either assessor 
compared with the treating surgeon, thus validating the 
audit processes. 

Furthermore, WSM and its ANZASM counterparts 
began collecting feedback from surgeons and hospitals 
through its annual evaluation survey. From the \ASM 
survey results, positive feedback on the value of the case 
note review booklets, as well as a perceived improvement 
in the local level of care was reported. Various exam- 
ples of improvements from learning outcomes in other 
clinical audits and registries to which WSM could refer 
included the observed changes in surgical practices in 
Western Australia,^ ^ the development of risk scores spe- 
cific to Australian patients who underwent cardiovascu- 
lar surgery,^^ the surgical outliers process embedded 
into the vascular audit system,^^ providing training pro- 
grammes within the health setting,^^ improving com- 
munication between medical and surgical teams,^^"^^ 
ensuring surgeons in Australia meet high standards of 
clinical practice and patient care^^ and the New Zealand 
perioperative mortality review committee activity. A 
recent review by Watters et af^ has shown that there is 
value in establishing a predictive model to reduce peri- 
operative mortality, but acknowledges that unless mortal- 
ity audits examine the circumstances surrounding deaths 



improvements will not occur. This has been well demon- 
strated in the original Scottish Audit of Surgical 
Mortality, which formed the basis for the establishment 
of ANZASM.^^ The Scottish audit has examined 9 years 
of data collection and found that adverse events were 
more commonly due to failures in system processes than 
to individual clinical errors. No other mortality audit has 
published a comprehensive analysis of differences 
between specialties but North et af^ did analyse delay in 
diagnosis and found that this factor was highest in 
general, cardio thoracic and vascular surgery. This corre- 
lates well with our data which found that delay in treat- 
ment was highest in general than vascular surgery. 

The main strength of this audit is its independent 
blinded peer review. The quality and depth of feedback 
to stakeholders is extensive. Limitations remain data 
quality, but this will improve when an electronic-only 
data capture method is adopted in 2014. Also only 
aggregate data can be provided to hospitals because of 
quality privilege legislation restriction. Although WSM is 
restricted to the analysis of deaths under the care of a 
surgeon and does not include morbidity or near misses, 
dissemination of outcomes of data collected and ana- 
lysed is associated with a reduction in the number of 
clinical management issues. 

We have highlighted the differences in clinical man- 
agement issues between specialties and demonstrated 
that the audit is associated with a reduction in these 
issues over successive audit periods. Focusing on specific 
areas of clinical management issues by specialties can be 
expected to continue this trend, with a positive impact 
on patient care. 
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